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Method and Apparatus for transmitting watermark data bits 
using a spread spectrum, and for regaining watermark data 
bits embedded in a spread spectrum 

5 The invention relates to a method and an apparatus for 
transmitting watermark data bits using a spread spectrum, 
and to a method and an apparatus for regaining watermark 
data bits embedded in a spread spectrum, wherein the water- 
mark signals are arranged at frequency bands where an audio 
10 signal is notch filtered. 

Background 

15 'Watermarking' means imperceptible insertion of information 
into multimedia, data, e.g. audio data and/or video data. The 
insertion of additional information data, such as a number 
or a text, into multimedia data is performed through slight 
modification of the original multimedia data. Watermarking 

20 can be used for e.g. copyright protection, labelling (e.g. 
URL of a site or a site's logo), monitoring, tamper proof- 
ing, or conditional access. 

Applying 'spread spectrum' in a (RF) communications system, 
means that a small baseband signal bandwidth is intention- 

25 ally spread over a larger bandwidth by injecting or adding a 
higher-frequency signal, or spreading function. As a direct 
consequence, the energy used for transmitting the signal is 
spread over a wider bandwidth, and appears as noise. 
Spread spectrum technology and the related inserted or added 

30 information signal can be used for implementing watermarking 
of e.g. digital audio signals, whereby the spread spectrum 
can use the complete audio spectrum from 0Hz to one half of 
the sampling frequency. This spectrum carries the informa- 
tion of one bit. 

35 

In a modification of such systems shorter spread spectrum 
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sequences are used leading to band limited spread spectrum 
signals, so that several ones of the band limited spread 
spectrum signals can be added at different centre frequen- 
cies to the audio spectrum, at which centre frequencies the 
5 original audio signal has been notch filtered, in order to 
increase the bitrate of the watermark signals and/or to pre- 
vent attacks on the watermarked signals. In this watermark 
system the spread spectrum signals are modulated on a car- 
rier. 

10 The watermark signals that are embedded in the audio signal 
should not be audible. But if the original audio signal 
spectrum has no sufficient energy level near a modulation 
frequency, the watermark signal will become audible. There- 
fore the watermark signals are inserted only in those fre- 

15 quency bands where the audio signal has substantial power, 
based on psycho-acoustic laws. 

A known processing for retrieving at receiver or decoder 
side the watermark signal information bit from the spread 

20 spectrum is convolving the received or replayed spectrum 

with a spreading function or sequence that is time-inverse 
with respect to the original spreading function or sequence, 
which kind of processing is also called 'applying a matched 
filter' . If BPSK modulation was used for applying the spread 

25 spectrum function, the output of this process is a peak at 
the middle of the sequence of correlation overlap-add val- 
ues, whereby the sign of such peak represents the value of 
the desired watermark signal information bit. If QPSK was 
used two peaks will be present in the sequence of correla- 

30 tion values, whereby each peak represents one bit value. 

Invention 



35 Because in prior art decoders the decoder has no a-priori 

information about which watermark signal carrier or carriers 
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are currently available in a current audio frame, the de- 
coder must check for all possible carrier frequencies in all 
candidate frequency bands whether a carrier is actually pre- 
sent. The disadvantage of this solution is that such check- 
5 ing for all possible carrier frequencies demands high proc- 
essor power, i.e. leads to a multiplied MIPS (million in- 
structions per second) demand. 



A problem to be solved by the invention is to keep the ro- 
10 bustness of modulated-carrier spread spectrum systems while 
reducing the required processing power for demodulating or 
decoding the watermark signal information bits. This problem 
is solved by the methods disclosed in claims 1, 2, 3 and 4. 
Corresponding apparatuses which utilise these methods are 
15 disclosed in claims 4, 5, 6 and 7, respectively. 

In some watermarking system applications, in which a certain 
encoder /decoder processing delay is acceptable, a forward- 
looking psycho-acoustic can be implemented, which means that 
2 0 at a given time instant, i.e. for a current audio signal 
frame, it is already known at encoder side in which fre- 
quency band or bands in the following audio signal frame the 
next watermark signal or signals, respectively, can be em- 
bedded. If this frequency band information is signalled in 

2 5 advance, i.e. is transmitted or transferred already together 

with the frame data for the current frame, the decoder knows 
before processing the following audio signal frame which 
carrier frequency or frequencies are occupied and must be 
used for the corresponding carrier demodulation,, and which 

3 0 carrier frequencies need not be checked and demodulated. 

The advantage of such inventive signalling-in-advance is a 
significantly reduced processing power or MIPS demand in the 
decoder. If on average e.g. 2 frequency bands out of in to- 
3 5 tal e.g. 6 candidate frequency bands are used, the process- 
ing power requirements will amount to about one third only. 
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On the other hand, the robustness against all kinds of at- 
tacks , and the inaudibility of the watermark signals , can be 
increased by providing in total an increased number of can- 
didate frequency bands, without need for more CPU power as 
5 compared to prior art technology. 

This inventive decoding processing works fine in case undis- 
turbed signal are received by the decoder. However, if the 
received input signals contain multipath or echo or rever- 
ie beration distortions, the convolved output signals will con- 
tain more than one peak per watermark signal information bit 
(i.e. per convolution result) to be decoded so that, e.g. 
depending on the amplitude or power of the distortion peaks, 
it is difficult or in many cases even impossible to retrieve 
15 the correct watermark information bits. 

Therefore an additional advantageous feature can be used. 
With respect to a watermark signal carrier-occupied fre- 
quency band in the current frame, according to the amount of 
the main echo delays or the mean echo delay, in a future au- 
20 dio signal frame, the time period of which frame correlates 
to that amount of echo delay, no watermark signal carrier is 
transmitted in the frequency band corresponding to that oc- 
cupied frequency band. Thereby the echo from the watermark 
signal carrier in the occupied frequency band in the current 
25 frame will occur at a frequency band in the future frame 

where no watermark signal carrier is present, and the number 
of watermark signal bit errors due to echoes caused by mul- 
tipath or reverberated reception conditions is substantially 
decreased. Preferably, the future audio signal frame is the 
30 audio signal frame following the current audio signal frame. 

The latter features can also be used without signalling in 
advance the future-occupied frequency band or bands, by us- 
ing a pre-determined pattern of differently occupied fre- 
35 quency band or bands in different audio signal frames, e.g. 
a regular pattern like staircase up (as depicted in Fig. 3) 
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In principle , the inventive method is suited for transmit- 
ting watermark data bits using a spread spectrum, said 
5 method including the steps: 

- modulating said watermark data bits on an encoder pseudo- 
noise sequencer- 
modulating said modulated encoder pseudo-noise sequence 

on a carrier frequency; 

10 - determining whether at one or more different candidate 
frequency band positions in a current frame of said audio 
signal the energy or amplitude level of said audio signal is 
such that it can mask one or more, respectively, of said 
modulated carrier frequencies and, if this is true, notch 

15 filtering said audio signal at the corresponding frequency 

band positions and inserting at this frequency or at each of 
these frequencies, respectively, said carrier frequency or 
one of said carrier frequencies, respectively; 

checking at which candidate frequency band positions in a 

20 frame following said current frame of said audio signal the 
energy or amplitude level of said audio signal is such that 
it can mask one or more, respectively, of said modulated 
carrier frequencies, and providing information about the lo- 
cations of these frequency band positions; 

25 - transmitting or transferring data of said current audio 

signal frame carrying said watermark data bits together with 
the information about the locations of the frequency band 
positions to be used in said frame following said current 
frame of said audio signal. 

30 

In principle, the inventive method is suited for transmit- 
ting watermark data bits using a spread spectrum, said 
method including the steps: 

modulating said watermark data bits on an encoder pseudo- 
35 noise sequence; 

- modulating said modulated encoder pseudo-noise sequence 
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on a carrier frequency; 

notch filtering a current frame of said audio signal at 
frequency band positions which are arranged in a pre-defined 
pattern across the sequence of frames of said audio signal 
5 and inserting at this frequency band position or at each of 
these frequency band positions, respectively, in said cur- 
rent frame of said audio signal said carrier frequency or 
one of said carrier frequencies, respectively; 

transmitting or transferring data of said current audio 
10 signal frame carrying said watermark data bits. 

In principle, the inventive method is suited for regaining 
watermark data bits embedded in a spread spectrum, whereby 
the corresponding original watermark data bits were modu- 

15 lated at encoder side on an encoder pseudo-noise sequence 
and said modulated encoder pseudo-noise sequence was modu- 
lated on a carrier frequency, and wherein at one or more 
different frequency band positions in a current frame of 
said audio signal the audio signal was notch filtered and 

20 one of said carrier frequencies was inserted instead, and 

wherein a current audio signal 'frame carrying said watermark 
data bits was transmitted or transferred together with in- 
formation about the locations of the frequency band posi- 
tions used for said carrier frequencies in a frame following 

25 said current frame of said audio signal, said method includ- 
ing the steps : 

- receiving and synchronising said transmitted or trans- 
ferred audio signal; 

- demodulating for a current audio signal frame said car- 
30 rier frequency or said carrier frequencies, respectively, 

thereby using said information about the location or loca- 
tions of the frequency band position or positions used for 
said carrier frequency or frequencies, respectively, which 
information was attached to the data for a previous frame of 
35 said audio signal; 

- convolving said current frame of data of said audio sig- 
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nal with a time-inversed version of the encoder pseudo-noise 
sequence; 

- determining from the sign of the peak or the peaks of the 
corresponding convolution result the value of a bit of said 

5 watermark data. 

In principle, the inventive method is suited for regaining 
watermark data bits embedded in a spread spectrum, whereby 
the corresponding original watermark data bits were modu- 
lo lated at encoder side on an encoder pseudo-noise sequence 
and said modulated encoder pseudo-noise sequence was modu- 
lated on a carrier frequency, and wherein at one or more 
different frequency band positions in a current frame of 
said audio signal the audio signal was notch filtered and 
15 one of said carrier frequencies was inserted instead, 

whereby said frequency band positions were arranged in a 
pre-defined pattern across the sequence of frames of said 
audio signal, said method including the steps: 

- receiving and synchronising said transmitted or trans- 
20 f erred audio signal; 

- demodulating for a current audio signal frame said car- 
rier frequency or said carrier frequencies, respectively, 
thereby using the information about said pre-defined pat- 
tern; 

25 - convolving said current frame of data of said audio sig- 
nal with a time-inversed version of the encoder pseudo-noise 
sequence; 

determining from the sign of the peak or the peaks of the 
corresponding convolution result the value of a bit of said 
30 watermark data. 

In principle the inventive apparatus is suited for transmit- 
ting watermark data bits using a spread spectrum, said appa- 
ratus including: 
35 - means for modulating said watermark data bits on an en- 
coder pseudo-noise sequence; 



WO 2005/059912 PCT/EP2004/010221 

8 

- means for modulating said modulated encoder pseudo-noise 
sequence on a carrier frequency; 

means for determining whether at one or more different 
candidate frequency band positions in a current frame of 
5 said audio signal the energy or amplitude level of said au- 
dio signal is such that it can mask one or more, respec- 
tively, of said modulated carrier frequencies and which 
means, if this is true, notch filter said audio signal at 
the corresponding frequency band positions and insert at 

10 this frequency or at each of these frequencies, respec- 
tively, said carrier frequency or one of said carrier fre- 
quencies, respectively, and which means check at which can- 
didate frequency band positions in a frame following said 
current frame of said audio signal the energy or amplitude 

15 level of said audio signal is such that it can mask one or 
more, respectively, of said modulated carrier frequencies, 
and provide information about the locations of these fre- 
quency band positions; 

- means for transmitting or transferring data of said cur- 
20 rent audio signal frame carrying said watermark data bits 

together with the information about the locations of the 
frequency band positions to be used in said frame following 
said current frame of said audio signal. 

25 In principle the inventive apparatus is suited for transmit- 
ting watermark data bits using a spread spectrum, said appa- 
ratus including: 

- means for modulating said watermark data bits on an en- 
coder pseudo-noise sequence; 

30 - means for modulating said modulated encoder pseudo-noise 
sequence on a carrier frequency; 

- means for notch filtering a current frame of said audio 
signal at frequency band positions which are arranged in a 
pre-defined pattern across the sequence of frames of said 

35 audio signal, which means insert at this frequency band po- 
sition or at each of these frequency band positions, respec- 



WO 2005/059912 PC T/EP2004/0 10221 

9 

tively, in said current frame of said audio signal said car- 
rier frequency or one of said carrier frequencies , respec- 
tively; 

- means for transmitting or transferring data of said cur- 

5 rent audio signal frame carrying said watermark data bits. 



In principle the inventive apparatus is suited for regaining 
watermark data bits embedded in a spread spectrum, whereby 
the corresponding original watermark data bits were modu- 
lo lated at encoder side on an encoder pseudo-noise sequence 
and said modulated encoder pseudo-noise sequence was modu- 
lated on a carrier frequency, and wherein at one or more 
different frequency band positions in a current frame of 
said audio signal the audio signal was notch filtered and 
15 one of said carrier frequencies was inserted instead, and 

wherein a current audio signal frame carrying said watermark 
data bits was transmitted or transferred together with in- 
formation about the locations of the frequency band posi- 
tions used for said carrier frequencies in a frame following 
20 said current frame of said audio signal, said apparatus in- 
cluding: 

- means for receiving and synchronising said transmitted or 
transferred audio signal; 

- means for demodulating for a current audio signal frame 
25 said carrier frequency or said carrier frequencies, respec- 
tively, thereby using said information about the location or 
locations of the frequency band position or positions used 
for said carrier frequency or frequencies, respectively, 
which information was attached to the data for a previous 

30 frame of said audio signal; 

- means for convolving said current frame of data of said 
audio signal with a time-inversed version of the encoder 
pseudo-noise sequence, which means determine from the sign 
of the peak or the peaks of the corresponding convolution 

35 result the value of a bit of said watermark data). 



WO 2005/059912 PCT/EP2004/0 10221 

10 

In principle the inventive apparatus is suited for regaining 
watermark data bits embedded in a spread spectrum, whereby 
the corresponding original watermark data bits were modu- 
lated at encoder side on an encoder pseudo-noise sequence 
5 and said modulated encoder pseudo-noise sequence was modu- 
lated on a carrier frequency, and wherein at one or more 
different frequency band positions in a current frame of 
said audio signal the audio signal was notch filtered and 
one of said carrier frequencies was inserted instead, 
10 whereby said frequency band positions were arranged in a 
pre-defined pattern across the sequence of frames of said 
audio signal, said apparatus including: 

- means for receiving and synchronising said transmitted or 
transferred audio signal; 

15 - means for demodulating for a current audio signal frame 
said carrier frequency or said carrier frequencies, respec- 
tively, thereby using the information about said pre-defined 
pattern; 

- means, for convolving said current frame of data of said 
20 audio signal with a time-inversed version of the encoder 

pseudo-noise sequence, which means determine from the sign 
of the peak or the peaks of the corresponding convolution 
result the value of a bit of said watermark data. 

25 Advantageous additional embodiments of the invention are 
disclosed in the respective dependent claims. 

Drawings 

30 

Exemplary embodiments of the invention are described with 
reference to the accompanying drawings, which show in: 
Fig. 1 Watermark signal encoder and watermark signal decoder 
according to the invention, using spread spectrum 
35 technique; 

Fig. 2 Audio signal masking level-dependent sample pattern 
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showing which frequency group or groups in which 
frame carry a watermark signal; 
Fig. 3 Regular sample pattern showing which frame in which 
frequency group can carry a watermark signal. 

5 

Exemplary embodiments 

In the watermark signal encoder section in Fig. 1 an origi- 

10 nal audio input signal AUS is encoded, or processed such 

that the masking level threshold information or the energy 
level information for an encoding is retrieved, using a psy- 
cho-acoustic model calculator PSYMC. The resulting masking 
level threshold, or energy level , information MLAUD for the 

15 audio data or its frequency spectrum coefficients (resulting 
e.g. from an FFT or MDCT) of a current audio signal input 
frame are fed together with related control data or coding 
parameters CTRLD to a watermark shaping notch filtering and 
embedding stage WATSFE . 

20 Input watermark data IWATD enter a bit value modulation 

stage BVMOD in which a current bit value of the IWATD data 
is used to correspondingly modulate a current encoder 
pseudo-noise sequence section ENCPNSEQ^i. For example, if 
the current bit value is 1 +l f , the encoder pseudo-noise se- 

25 quence section ENCPNSEQ_i is left unchanged whereas, if the 
current bit value is f 0' or 1 -1', the encoder pseudo-noise 
sequence section ENCPNSEQ_i is inverted. Sequence ENCPNSEQ_i 
consists of e.g. a 'random' distribution of '0' or '-1' and 
f +l f . The pseudo-noise sequence section ENCPNSEQ_i can have 

30 a length corresponding to that of the audio signal frames. 
However, if two different sequences ENCPNSEQ__1 and 
ENCPNSEQ_2 are used each of which has a length that is one 
half of the audio data frame length (of e.g. 4096 samples), 
two watermark data bits per audio frame can be transmitted. 

35 If N different sequences ENCPNSEQ_1 to ENCPNSEQ_N are used, 
each one of them has a length of 1/N of the audio data frame 
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length, and N watermark data bits per audio frame can be 
transmitted. 

The pieces of watermark signals WATS resulting from stage 
BVMOD are fed to a frequency carrier modulator stage FCMOD 
5 wherein the watermark signals WATS are modulated on differ- 
ent frequency carriers f c i, according to the frequency bands 
used. 

The modulated watermark system depicted in Fig. 1 uses e.g. 

10 6 carrier frequencies in 6 frequency bands as depicted in 
Fig. 2. In vertical direction the number of the frequency 
band FB is counted. In horizontal direction the number of 
the audio signal frame FRMNO is counted, i.e. the horizontal 
axis represents time whereas the vertical axis represents 

15 frequency. At every time instant, i.e. in every frame, be- 
tween zero and 6 watermark signals can be inserted in the 
corresponding frequency bands, the number and location de- 
pending on the current masking level threshold or the cur- 
rent energy level. 

20 

In a subsequent watermark shaping, notch filtering and em- 
bedding stage WATSFE the output signal of stage MOD is com- 
bined with, or added to, corresponding frame sections of au- 
dio data. 

25 If the audio signal to be transmitted is represented in the 
time domain, the audio signal is notch filtered at the car- 
rier frequencies to be inserted, whereby the presence and/or 
amplitude of a carrier depends on the current masking level 
threshold or the current energy level of the audio signal. 

30 If the audio signal to be transmitted is represented in the 
frequency domain, the processing in stage WATSE is performed 
as follows. A current encoder pseudo-noise sequence section 
ENCPNSEQ_i is transformed into the frequency domain. In the 
frequency domain, this sequence is 'shaped 1 according to, 

35 i.e. its amplitudes envelope is made conforming to, the cor- 
responding frame section masking level threshold or energy 
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level shape or curve in masking level threshold information 
MLAUD. 

In case there are e.g. two encoder pseudo-noise sequence 
sections per audio frame, sequence ENCPNSEQ__1 is shaped ac- 
5 cording to the masking level shape or curve in the first 
half of the audio frame and sequence ENCPNSEQ_2 is shaped 
according to the masking level shape or curve in the second 
half of the audio frame. 

The frequency domain audio signal is notch filtered at the 
10 carrier frequencies to be inserted and the corresponding 

carriers are inserted instead, whereby the presence and/or 
amplitude of a carrier depends on the current masking level 
threshold or the current energy level of the audio signal. 

15 For example, the audio signal to be watermarked at time in- 
stant 2 has only in the frequency band 3 enough energy to 
allow for an inaudible embedding of a watermark signal car- 
rier. In a prior art watermark signal extractor all 6 bands 
must be decoded only to find that five of them do not con- 

20 tain any watermark signal. 

As mentioned above, in some applications a delay of the 
length of one watermark data frame is acceptable. According 
to the invention, the psycho-acoustics relevant for audio 
data frame 2 can already be calculated before the watermark 

25 signal carriers for audio data frame 1 are inserted. As a 

result it is signalled to the decoder during the audio data 
frame 1 period that in audio data frame 2 frequency band 3 
only will be occupied by a watermark signal carrier, and the 
decoder will decode this single band only. During the audio 

30 data frame 2 it is to the decoder that frequency bands 1, 2 
and 4 will be occupied by a watermark signal carrier, and so 
on. 

A watermark 'packet' is formed in stage WATSFE or in stage 
35 TRM, or in a non-depicted controller, from the watermark 

signals of several frames, each one of which frames carries 
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one bit per frequency band used for a watermark signal (if 
there is used one encoder pseudo-noise sequence per fre- 
quency band) • A watermark packet carries several bits of 
which one or more are used for signalling the occupation of 
5 the frequency bands in the, or a, following audio signal 
frame . 

In a different embodiment, the feature of signalling in ad- 
vance the future-occupied frequency band or bands is not re- 

10 quired. A pre-determined pattern of differently occupied 

frequency band or bands in different audio signal frames is 
used, e.g. a regular pattern like that in Fig. 3. Thereby in 
each audio signal frame the same number of frequency bands 
is occupied, e.g. one or two per audio signal frame. The 

15 above-mentioned stages do not include the signalling infor- 
mation in the watermark packets. Because of the regular pat- 
tern and the irregular audio signal masking level threshold 
or energy level threshold, either all watermark signal car- 
riers have an equal low amplitude, or have different (i.e. 

20 adaptive) amplitudes. 

The output signal of stage WATSFE passes through transmitter 
stage TRM (which includes e.g. a D/A converter and/or an am- 
plifier) and channel WATAUTRMCH to a watermark signal de- 
25 coder or receiver. 

Unintended, in the watermarked audio transmission channel 
WATAUTRMCH a noise or reverberation or echo signal NRE is 
added. This channel can be represented by an acoustic con- 
30 nection between a loudspeaker and a microphone. 

In the watermark signal decoder section in Fig. 1 the dis- 
torted transmitted signal enters a receiver stage REC, 
wherein e.g. a coarse synchronisation and/or an A/D conver- 
35 sion is performed. Its output signal passes via a bit or 
fine synchronisation stage SYNC and a band filter and de- 
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modulator stage BFDEMOD to a data recovery matched filter 
stage BFDEMOD, or time-inverse convolution stage DRECMF. In 
stage BFDEMOD the carrier-modulated watermark signals in the 
different frequency bands are demodulated using a carrier 
5 frequency f c ^ corresponding to that used in stage FCMOD in 
the watermark signal encoder. Also, the above-mentioned sig- 
nalling information contained in the watermark packets is 
retrieved in case no regular pattern-occupation of frequency 
bands was used. Stage BFDEMOD convolves, or filters, the 

10 carrier-demodulated watermark signals of a current incoming 
audio frame coming from stage BFDEMOD with a decoder pseudo- 
noise sequence ENCPNSEQ_i that is pre-known by, or stored 
in, the decoder and is time-inverse to the related encoder 
pseudo-noise sequence section ENCPNSEQ_i . Basically, a cor- 

15 rectly transmitted watermark bit 'appears 1 as a peak in the 
middle of the 2*N-1 intermediate correlation results. How- 
ever, due to echo signals a peak could occur at the same or 
a different position. 

In case e.g. two orthogonal encoder pseudo-noise sequence 
20 sections per frequency band per audio frame were used in the 
watermark signal encoder, sequence DECPNSEQ_1 is convolved 
with the first half of the corresponding frequency band sig- 
nal and sequence DECPNSE(2_2 is convolved with the second 
half of that frequency band signal. 
25 Stage DRECMF provides the watermark signal decoder output 

watermark data OWATD which correspond to the input watermark 
data IWATD. 

The pseudo-noise sequences used are calculated by a given 
30 algorithm based on a start value. In order to transmit se- 
cret watermark data, the start value or even that algorithm 
can be encrypted and transmitted to the watermark signal de- 
coder wherein it is used to calculate the decoder pseudo- 
noise sequences DECPNSEQ_i and the modified decoder pseudo- 
35 noise sequence MDECPNSEQ. 



